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CN Abstract 

Q In this paper we study coordinated multipath routing at the flow-level in networks 

Q with routes of length one. As a first step the static case is considered, in which the 

niunber of flows is fixed. A clustering pattern in the rate allocation is identified, and 
we describe a finite algorithm to find this rate allocation and the clustering explicitly. 

Then we consider the d5mamic model, in which there are stochastic arrivals and de- 

^ partures; we do so for models with both streaming and elastic traffic, and where a 

Q peak-rate is imposed on the elastic flows (to be thought of as an access rate). Lack- 

ing explicit expressions for the equilibrium distribution of the Markov process under 
consideration, we study its fluid and diffusion limits; in particular, we prove unique- 
2 riess of the equilibrium point. We demonstrate through a specific example how the 

diffusion limit can be identified; it also reveals structural results about the clustering 
pattern when the minimal rate is very small and the network grows large. 
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^ 1 Introduction 

00 

Balancing flows over different routes, commonly referred to as multipath routing, bears 
O important advantages. First, it makes the network more robust, because in case of a link 

failure, the flow can still use bandwidth on its other routes. Also, under multipath routing 
O the resources of the network are used more efficiently since overcongested flows have 

^ more flexibility to spread their traffic over undercongested parts of the network. In this 

^ paper we want to elaborate on the latter aspect. Questions we are particularly interested 

^ in are: How are the resources shared under multipath routing, what causes congestion, 

and how are these congestion phenomena affected by the number of routes that a flow 
can use? 

Recently, multipath routing has attracted substantial attention from the research commu- 
nity. We specifically mention here models that consider the flow-level, i.e., the timescale 
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at which the number of flows stochasticafly changes: flows arrive at the network, use a 
set of links for a while, and then leave. Flows can be divided into streaming and elas- 
tic flows: streaming flows (voice, real-time video) are essentially characterized by their 
duration and the rate they transmit at; on the other hand, elastic flows (predominantly 
data) are characterized by their size, while their transmission rate is a function of the 
level of congestion in the network. An implicit assumption in flow-level models is that 
of separation of time-scales, meaning that the time it takes for the rate to adapt is negligible 
compared to changes at the flow-level. A flow-level model for multipath routing, which 
integrates elastic and streaming traffic, is due to Key and Massoulie |71; models in the 
context of rate control can be found in the work by Kelly and Voice li5l lT3| . 

In this paper we consider multipath routing at the flow-level in networks with routes of 
length one, adopting the model of [7] for coordinated multipath routing. Here coordinated 
multipath routing means that rates are allocated so as to maximize the utilities of the 
total rates that flows obtain. This is in contrast with uncoordinated multipath routing, 
where flows on different routes are treated as different users; then one maximizes the 
utilities of the rates that a flow achieves on each route. As pointed out in |7|, such an 
uncoordinated mechanism generally leads to inferior performance. There a fluid limit for 
the model of integrated streaming and elastic traffic was established, and uniqueness of 
the equilibrium point was proven. A first contribution of our work is that we consider 
a perhaps more realistic model in which the elastic flows have an upper bound they can 
transmit at. Imposing such a peak rate has significant advantages when analyzing the 
model mi; in addition it has a natural interpretation, as the constraint on the rate can be 
thought of as the rate of the bottleneck link (for instance the access rate). For this model 
we establish a fluid limit, and prove existence and uniqueness of an equilibrium point; in 
addition we describe a (finite) algorithm that finds this equilibrium point. 

One of the difficulties in the analysis of multipath routing, is that the rate allocation can- 
not be given explicitly, even when the number of flows is fixed; instead, it follows by 
solving an optimization problem. Additionally, this optimization problem contains fur- 
ther variables, determining how users split their flow on different routes, for which there 
is in general no unique solution. The second contribution of this paper, is that we ease this 
analysis by finding generalized cut constraints for the case of routes of length one. These 
generalized cut constraints assume there are certain cuts, i.e., subsets of resources, of the 
network that give sufficient constraints to determine the feasibility of a flow. Introducing 
these reduces the optimization problem to one with the total rates being the only vari- 
ables over which we are optimizing. In the rate allocation for a given number of flows, 
we identify a clustering of flows and resources. The generalized cut constraints enable us 
to construct an algorithm that finds the rate allocation and the clustering explicitly. 

Related to the question how flows share resources in a multipath network, a crucial con- 
cept is complete resource pooling, which is a state in which the network behaves as if all 
resources are pooled together, with every user having access to it. It is clearly desirable 
to achieve this state, as then resources can be shared fairly among all flows and, due to 
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the concavity of the utiHty functions we are using, in the most utiHty-efficient way. (Also, 
this implies that if a network is already in complete resource pooling then increasing the 
number of routes that a flow can use does not change the rate allocation since the network 
already operates in the best possible way. However, increasing the number of routes will 
make it more likely for the network to be in a complete resource pooling state.) Complete 
resource pooling was already studied by, e.g.. Laws Q and Turner l|TT]| for networks 
where users must use one route only but have a set of possible routes to choose from. In 
this paper, we give explicit conditions for the equilibrium point of the fluid limit to be of 
the complete-resource-pooling type. 

Our last contribution relates to the purely symmetric circle network. Each flow is allowed 
to use r given routes; we call the network a circle network as the resources can be arranged 
in a circle. This setup is reminiscent of the supermarket model by Mitzenmacher ITOll , 
where every flow chooses one of a set of r randomly chosen routes; we believe our model 
is the more natural one, as users would naturally choose from a set of routes in their 
proximity. We study the effect increasing r, the number of routes that a flow can use, has 
on congestion in the network. To this end we define 'congestion' as the event that there 
is a flow that can transmit at a rate of at most some small value e. We then investigate in 
what kind of cluster this congestion event is most likely to occur. Using diffusion-based 
estimates, we derive expressions for the corresponding probabilities, and conclude that, 
as the size of the network grows large, the cluster with highest probability of congestion 
has size r — 1. 

The outline of the paper is as follows. In Section 2 we introduce the model of multipath 
routing in general networks. We describe the optimization problem that gives the rate 
allocation for a given number of flows. For the case of routes of length one we describe 
the clustering in the rate allocation, and introduce notions of connected and strongly con- 
nected sets. In this context we also introduce the generalized cut constraints. Section 3 
further investigates the rate allocation, for a given number of flows. We develop the al- 
gorithm that identifies this allocation, which also gives explicit expressions for the max- 
imum and minimum rate (over all flows), as well as a lower bound on the rate allocated 
to each of the flows. 

In Section 4 we then move to the model that incorporates a flow level, and which involves 
streaming and (peak-rate constrained) elastic traffic, as described above. In the scenario 
of streaming traffic only, the stationary distribution of the corresponding Markov chain 
is given explicitly, but for the other cases this is infeasible. We therefore resort to fluid 
limits in Section 5. After briefly reviewing the results of [7], we specifically consider the 
fluid limit for peak-rate constraint elastic traffic, and prove the uniqueness of an equi- 
librium point. We also introduce the concept of complete resource pooling, and provide 
conditions for the equilibrium point of the fluid limit to be in complete resource pooling 
for both cases, with integrated streaming and elastic traffic and with peak-rate constraint 
elastic traffic. 

In Section 6 we turn to the diffusions around the equilibrium point. We explicitly estab- 
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lish the diffusion limit for the purely symmetric circle network. We will calculate the 
covariance matrix of the stationary distribution that belongs to this diffusion. Relying on 
these estimates, we present expressions for the probabilities that congestion occurs (that 
is, some transmission rates are below some critical value e) with a cluster of size k, so as 
to identify the most-likely size of the cluster in periods of congestion. 

2 Definitions and preliminaries 

In this section we first define in our multipath setting, given the number of flows present, 
the allocation of rates to these flows. We will make this allocation more explicit in the 
next section. In practice, of course, the number of flows will change over time; in Section 
4 and further we consider this setting (where we use the results derived in Section 3 for 
a given number of flows present). A second goal of this section is to introduce useful 
notions such as clusters and (strong) connectivity. 

2.1 Rate allocation 

We consider networks with multipath routing, i.e., we have a set of resources J with 
capacities {Cj)j^j, users (interchangeably referred to as flow types) / and routes R. User 
i can use routes in R{i) C R, where each route r G 72 is a set of resources r C J. As 
mentioned above, in this and the following section we still consider the number of flows 
to be fixed. 

Let Ui denote the number of file transfers of type i then the vector (xj) jg/ of rates allocated 
to flow of type i is the unique solution to the concave optimization problem: 

Maximize Y.i&i ^i^ii^i) 

x[ >0 yi£l,rGR{{}. 

Here x[ is the rate with which flow of type i is processed on route r. We agree that Xi = 
if Ui = 0. Also, we can define variables x[ = for r E R{i). Following [71, the utility 
functions Ui are assumed to be strictly concave, strictly increasing and differentiable. A 
utility function that is frequently considered in this context is 

Ui{x) = Wi- , 

1 — a 

for given weights Wi) this type of utility curves is usually referred to as weighted a- 
fairness. In this paper we will disregard weights and consider Ui{-) = U{-), i.e., each 
user has the same utility function. 

Considering routes of length one only, the following results are irrespective of the explicit 
form of the function U and only require that it is a strictly concave, strictly increasing , 
and differentiable common utility function. Here we leave the notion of route, and let 
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J{i) be the set of resources user i can use. Now, denotes the rate user i receives from 
resource j. Then our optimization problem reads: 



(2) 



Maximize Y^i(zjniU{xi) 

x{ >0 'iie 1,3 e J{i). 
The stationary conditions of the corresponding Lagrangian are 

Xi >{U')~^{^ij) with equaUty if x-^ > 
Ei:iGj(i) = Cj yj s.t. 3i, j e J{i),ni> 0, 

where /ij is the Lagrange multipliers corresponding to resource j. Then we can see that 
for any function U as above the optimal solution x is sufficiently characterized by 



Xi, > Xi2 ^ xl^ =0 Vj G J(n) n J{i2) 



(4) 



2.2 Clusters, connectivity 

With Q we can discover a unique partition of (/, J) into a collection of clusters of the 
form (/', J') , similarly to Hajek's notion [2J. This is the same for any strictly concave 
differentiable function U. 

Definition 2.1. We define a cluster to he a non-empty pair (/', J') with I' I, J' Q J such 
that if i G /' then I' consists of all i' e I such that there exists a path i = iQ,ii,i2, ..in = 
i' G I' ,ji,j2---jn G J' such that for a feasible allocation x solving (2i x^^^ and x^^ are strictly 
positive for all k = l,...n. Similarly, J' consists of all j G J for which there exists a path 
i = io, n, ■■in-i G I', ji,j2---jn = j & J' such that for a feasible allocation x solving (jij) 
and x^^ are strictly positive for all k = 1, ...n. with x^ > 

This gives indeed a unique partition since it can be checked that the existence of a path 
between i and j, or respectively between i and j' or j and /, is an equivalence relation. It 
can be easily deduced from Q that if i and i' are in the same cluster then Xj/ = Xj. 
Intuitively, a cluster (/', J') is such that the optimal rate allocation is as if all resources 
of J' are pooled together with exactly all flows of /' having access to it. Consider Figure 
1 which shows a circle network of four resources (described by squares labelled 1, 2, 3, 
and 4) of unit capacity and four flow types (described by circles labelled 1, 2, 3, and 4). 
Each type i can use resources i and i + 1, which is illustrated by edges (where 4 + 1 is 
understood as 1). In this example ni, the number of flows of type 1, is relatively large, ie. 
suppose ni = 4,n2 = n-^ = = 1, so that flows of type 1 monopolize resources 1 and 
2. Types 2, 3 and 4 are sharing resources 3 and 4 equally. Thus we have two clusters, one 
consisting of flows of type 1 and resources 1 and 2, and another consisting of flow types 
2, 3, and 4 and resources 3 and 4. 
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Figure 1: Possible clustering for a circle network with four resources 



As a consequence of the previous definition all flows i in the same cluster will have the 
same rate Xi. If we have two distinct clusters in which the common rate Xi is the same, 
then we say that these clusters are at the same duster level. 

For a cluster (/', J') we then have that the set I{J') = J(i) C J'}, i.e., the set 

consisting of all i that have to go through J', is a subset of I' . We will be particularly in- 
terested in the event of complete resource pooling, i.e., when (/, J) is just a single cluster. 

The following notions of connectivity help us to characterize the structure of the network 
and to identify clusters. These notions concern the general structure of (/, J, J{i)) without 
taking into account the allocation at state n. 

Definition 2.2. A pair (/', J') ivith I' I , J' ^ J is connected if J' cannot be partitioned in 
nonempty Ji, J2 such that I' can be partitioned into Ii, I2 with J{i) D J2 = ^ for i G /i and 
J{i) n Ji = 0/or i G h- Equivalently, for all G J' there is a path h,i2, --in G I', jo = 
j,ji,j2---jn = f e J' such that jk,jk+i G -'^(^fc+i) for all k = 0,..n-l 

Regarding (I, J, J{i) ) as a bipartite graph with nodes / and J and an edge between i G / 
and j e J if and only if j G J(i), we see that a pair (/', J') is connected if and only if the 
subgraph (/', J') is connected. We can also see that for (/', J') to be a cluster it has to be 
connected. 

Definition 2.3. A subset J' C J is connected if {I, J') is connected. We define J) to he 
the set of connected subsets of J. A subset J' Q J is strongly connected if {I{J'), J') is 
connected. Let ^"^{J) he the set of strongly connected subsets of J. 

Figure 2 demonstrates connected sets of the circle network with four resources from Fig- 
ure 1. Any set of consecutive resources {1,2}, {1,2,3} and also {1,2,3,4} and {1} are 
connected as are the sets isomorphic to these. Here, all of these sets are also strongly 
connected since consider eg. /({1, 2, 3}) = {2, 3} and any splitting of {1, 2, 3} into two 
non-empty sets would lose either user 2 or 3. 
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Figure 2: Connected sets of resources in the circle network with four resources 



It is immediate that 'strongly connected' implies 'connected'. However, the reverse is 
not true as Figure 3 illustrates. Here the set of resources 1, 2 and 3 is connected, but not 
strongly connected, since we can partition it in subsets {1, 2} and {3}. Then /({I, 2, 3}), 
which contains flow type 1 only, is the same as /({I, 2}). The notion of strongly connected 
sets is so important because it enables us to identify the generalized cut constraints in the 
next section, and they are also essential to the rate-allocation algorithm of Section 3. 




Figure 3: Network with set of resources {1,2,3} being connected but not strongly con- 
nected 



2.3 Generalized cut constraints 

The feasibility constraints from Q are inconvenient because they involve additional vari- 
ables for which there is no unique solution. However, we can rewrite them in terms of 
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the Xi as 

*e/(J') jeJ' 

These inequalities are called generalized cut constraints. They will be inevitable in the 
next section when proving the validity of the optimal allocation attained by our pro- 
posed algorithm. The equivalence of these generalized cut constraints to the feasibility 
constraints from (|2| is proved in Lemma A.l in the appendix. Kang et al. ||6| have shown 



in their Proposition 5.1 that it is possible even for the general multipath network to write 
the feasibility constraints in terms of generalized cut constraints as 

A{nx) < C 

where ^4 is a some non-negative matrix and C is a positive vector; here {nx) refers to the 
vector with f-th coordinate equalling niXi. However, no explicit expression for A and C 
has been found so far in such a general multipath network. 



3 Rate allocation for a given number of flows 

So far we characterized the rate allocation (for a given number of flows) as the solution to 
an optimization problem; we did not give any explicit expressions. This section gives a (fi- 
nite) algorithm that identifies this allocation, and which in addition yields the clustering. 
We finally also present explicit expressions for the minimally and maximally achieved 
rate (over all classes). 

To ease notation we write in the following for J' C J 

C{J') ■.= Y.Cy 

Also, for r I, J' J,we write 

C{J') 



r{l',J') :-- 



Note that this is the rate in cluster (/', J') if (/', J') is a cluster. If (/', J') is a union of 
clusters {Ik, Jk), then 

rir J') = ^ 

which means that r(I', J') is a weighted harmonic mean of the rates r{Ik, Jk) of clusters 
{Ik, Jk) with corresponding weights C{Jk)- It is important to note that the same still holds 
if {Ik, Jk) are not necessarily clusters, i.e., when we only know that (/', J') is a union of 
pairwise disjoint {Ik,Jk)- In the sequel we write 

En 

S2(_ttl,...,ttnJ — 
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to denote a weighted harmonic mean of ai, . . . , a„, with weights we > 0, £ = 1, . . . , n. 
In the cases we deal with, the magnitude of the weights will either be not important or 
obvious, e.g., when r(/', J') = $7 (r(/i, Ji), . . . , r{lK, Jk)), the corresponding weight for 

r(/fc, Jk) is Jfe. 

Now we are ready to describe the algorithm that finds the optimal allocation x and the 
clustering, when the number of flows present is given by the vector n. 

Theorem 3.1. for general networks with routes of length one and fixed number of flows n the 

optimal X = x{n) can be obtained by the following algorithm: 

Fork>l 



Find the minimum 



mill r(I(J'),J') (6) 



• Let Jk be the union of all arguments that achieve the minimum above and := I{Jk) 

• For all i & Ik 1st Xi be the minimum of above. 

• Now, set I := I\I{Jk), J := J\Jk d-nd J{i) := J(i) n {J\Jk), so that we also have 
I{J') := I{J' U Jfe)\/( Jfc). Repeat this procedure with the reduced network until we are 
left with a network without resources and users. 

Moreover, {Ik, J k) found at the k-th step of the algorithm is the union of all clusters at the k-th 
level. The strongly connected sets that are arguments of^ with their corresponding I {J') being 
the clusters of the network. 

Observe that this algorithm is well defined. For any finite network with set of resources 
J ^ $ there will be at least one and a finite number of J' G ^"^{J). Thus, the minimum 
exists at each step. Also, the algorithm will stop because of the network being finite. In 
order to prove Thm. |3.1} we need the following essential properties. The proof of the 
lemma is given in the appendix. 

Lemma 3.2. At each step k of the algorithm for the corresponding {I, J), we have 

1. yj' CJ: r{I{J'),J') > xk. 

2. Ifr{I{J'), J') = Xkfor J' C J then J' C J^. 

3. r{I{Jk),Jk) = Xk- 

4. Xk < Xk+i, i.e., cluster levels are found in increasing order of their rates. 



Proof of Thm. 3.1 We need to check that the allocation x achieved in 3.1 satisfies the rela- 



tions (Q with cluster levels Jk- For this we need to show the following. 

1. At each step k the allocation within the kth cluster level {Ik, Jk) is feasible, i.e., none 
of the constraints of ^ for J' e y^{Jk) is violated taking the amended J{i) := 



J{i)\J{[ji^k "^i)- Lemma 3.2 1 we have 

r{I{J'),J')>Xk 
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where Xk = Xi for all i G I{J') ^ Ik- So, this implies that we have 

niXi<C{J'), 

as desired. Also, Xj > and Xj < oo if nj > 0. 

2. The first line of Q holds: Consider any ii,i2, not at the same level, and j G ^(^i) H 
J(i2). Assume < Xi^, which implies (by Lemma 3.2 4) that ii is at an earlier 
cluster level than i2, say {Ik, Jk)- Then since n e -^(UKfc Ji) = {i ^ I '■ J{i) ^ 
UKfc J;} and j e J(ii), we know that j G Ui<fc Ji- 

So, j is at a cluster level before ^2 and x]^ = 0. 

3. No capacity is wasted. At each cluster level (/fc, Jk) where h ^ the total load is 

^ mxk = ^ nir(4, Jfc) = C( Jfc) 



where the first equality follows from Lemma 3.2 3. Since we know that none of the 
capacity constraints is violated, we conclude that each link is fully used. 

Note, when = 0, we have x^ = oo, so this must be at the last level. The union of 
the earlier clusters then has the form (/(J\Jfc), J\Jk) with /( J\ J^.) = /, so {i G / : 
J{i) n Jfc / 0} = and the links in J' were redundant. 

This completes the proof. □ 



With the rate-allocation algorithm of Thm. 3.1 at our disposal, we can give an expression 
for the minimal and maximal rates. 

Theorem 3.3. For general networks with routes of length one the minimal and maximal rates are 

mmxj = mm (/) 

i€i j'eynj) Ei6/(j') 

CiJ') 

maxxj = max . (8) 

iei J'&nJ) Ei:j(i)nJV0 

Proof. The proof for the minimal rate follows immediately from ( |3.1| . For the maximal 
rate we know from (3.1 1 that at the last step we are left with clusters of the form (/', J') 
such that r = {i e I : J{i) n J' / 0}, so the maximum of ^ gives an upper bound for 
the maximal rate. To see that this maximum is actually attained, let J' be the argument 
for the maximum in Then /' = {i G / : J{i) D J' ^ $} is the set of all flows that can 
possibly use resources in J'. So, a weighted harmonic mean of the rates of flows i G I{J') 
is at least 

C{J') _ 

Hence there must be at least one flow having a rate greater than or equal to this and so 
the maximal rate follows. □ 
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Also with Theorem 



3.1 



we can give a lower bound on the rates of any flow. 



Theorem 3.4. For each i £ I zve have 

C{J') 

Xi > mm . 

J'CJ:ieI{J') rii 

Proof. We know i has to be in some cluster, say {Ic,Jc) where c is the order it appears in 
( |3.1| . Consider the union of {Ik, Jk) for k < c. This will be of the form {I{J'), J'). Since 
r{I{J'), J') is a weighted harmonic mean of the rates of clusters {Ik, Jk) for k < c, and 
since among those the cluster of i has the highest rate, we find the lower bound on Xj. □ 

Remark 3.5. In the minimizations and maximizations above we could always look at 
general subsets instead of connected ones, and the proofs would work in exactly the 
same way. However, restricting to connected or even strongly connected sets is sufficient, 
and has the important advantage of decreasing the number of sets over which we are 
minimizing. 



4 Models at the flow-level 



Where the previous section considered the rate allocation for a given number of flows, we 
now add a dynamic component: we let flows arrive (according to a Poisson process), use 
a set of links for a while, and then leave again. Given that, at some point in time t, there 
are {ni{t))i^j flows present, then the rates are allocated as in ([l]|. Under the appropriate 
exponentiality assumption regarding the flow size distribution, {n{t))t>o is a continuous- 
time Markov chain. 

We distinguish between two different kinds of traffic: streaming and elastic traffic. Stream- 
ing flows have a random but fixed duration that is independent of the current level of 
congestion; think of voice or streaming video. Elastic flows have a random but fixed size 
(say, in Mbits). In the sequel we consider three cases, one with purely streaming traffic, 
one with integrated streaming and elastic traffic, and one with elastic traffic only in which 
we impose a peak rate. 



4.1 Purely streaming traffic 

If only streaming traffic is present, then the transition rates do not depend on the resource 
allocation x. Assume that flows of type i arrive according to a Poisson process with 
rate ki, and that their duration is exponentially distributed with mean l/r]i. With mi{t) 
denoting the number of streaming traffic of type i at time t, it is evident that the transition 
rates are those of a multidimensional M/G/oo queue: 
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It follows immediately that in steady-state the (mj(t)) are independent Poisson vari- 
ables with mean Kj/r^j =: pj. It is natural to assume that streaming flows are blocked 
if the allocated rate falls under a certain threshold. Denoting the set of feasible states by 
A, we obtain [4J that the corresponding equilibrium distribution is proportional to the 
multivariate-Poisson distribution given above. In particular. 



P(flow of type i is blocked) 



X^fceA Hie/ 'tj. 



where Ai is the set of vectors n e A such that n + ^ A, with ej representing the i-th 
unit vector. We end with the obvious remark that since the equilibrium distribution is of 
product form, it is the same for any duration distribution with means 1 / r/j; the blocking 
probability is insensitive to the service time distribution. 

4.2 Integrated streaming and elastic traffic 

Here we review the model of integrated streaming and elastic traffic that was consid- 
ered by Key and Massoulie [7J. Importantly, in this model streaming and elastic traffic 
are treated the same, in the following sense. The rate allocation is computed, for both 
streaming and elastic flows through ([T]). Streaming flows terminate 'autonomically', that 
is, with a rate that does not depend on the current congestion level (and hence also not 
on their current transmission rates). Elastic flows, however, terminate with a rate that 
is proportional to their momentary transmission rate. With n{t) corresponding to elastic 
flows and m{t) to streaming flows, this leads, in self-evident notation, to a Markov chain 
with transition rates: 

(n,m) {n + ei,m) : Aj 
(n,m) ^ (n - ej,m) : ^iniXi{n{t)) 
(n, m) ^ (n, m + e,) : Ki 
(n, m) {n,m — e,) : Turrn 

In [Zl it was shown that in this model the addition of streaming traffic brings some sort 
of a 'stabilization effect' to the network; as a result, the model has a non-trivial fluid limit 
(that is, a fluid limit with an equilibrium point that does not equal 0). They claim that a 
sufficient and necessary condition for stability that the pi := Xi/ pi have to satisfy is 



[ E^eJ-Hj)Pij < Cj Vj G J. 



(10) 



With the generalized cut constraints ^ we can rewrite this condition as 

^ Pi< C{J') VJ' e y^iJ). (11) 

i6/(J') 

Note that the stability constraints do not involve the streaming flows; as their rate can be 
pushed down arbitrarily low, their presence has no impact on the stability of the network 
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(which may be considered a less realistic feature of this setup). An important observation 
is that no closed-form expression of the equilibrium distribution of this Markov chain is 
available. 



4.3 Elastic traffic with peak-rate constraints 

Finally, we consider a network with elastic traffic only. We impose a peak rate on the 
flows' transmission rates. As argued in [IJ, this is convenient as it facilitates the analysis of 
the corresponding fluid limit (see Section 5 of the present paper); in fact, the introduction 
of peak rates has again a 'stabilization effect' (cf. the previous subsection), in that it leads 
to non-trivial fluid limits. In addition, it is remarked that imposing peak rates is quite 
natural: it is not realistic that flows can transmit at link speed; in fact the peak rates can 
be interpreted as the access rates of the users. We denote the peak rate of type i by r j . In 
self-evident notation, this leads to a Markov chain with transition rates 

{n ^ n + Cj : Aj 
n^n-ei-. fj.inimm{xi{n{t)),ri}. 

Here we want the loads pi := Xi/p.i to be such that the stability condition ([To)| for the 



integrated streaming and elastic traffic case of [7J holds, which again translates to (11 1. It 
is conceivable that this is the stability condition for this case. It is noted that, again, no 
closed-form expression of the equilibrium distribution of this Markov chain is available. 



5 Results under the fluid limit 

As mentioned above, the Markov chains presented in the previous section do not lead to 
a closed-form steady-state distribution (except for the purely streaming case). This moti- 
vates why we now explore these systems under a fluid scaling. Loosely speaking, a fluid 
scaling for the process n{t) is the sped-up process n^{t) that we obtain when we scale up 
arrival rates and capacities by the same factor L. The fluid limit is then the rescaled pro- 

(t) 

cess ^ ' , in the limit as L ^ cxd, which then gives a reasonable approximation of the real 
system when arrival rates and capacities are large. In our work we will not treat in detail 
the convergence issues that play a role here; see for instance ISI for more background. 
In the previous section, we mentioned that either adding streaming traffic or imposing 
peak rates has the effect that we obtain a non-trivial fluid limit. To explain what goes 
wrong otherwise, consider the following argument. In case of elastic traffic only, without 
a peak rate, the dynamics of the fluid limit are given through 

= Aj - /Xjnj(t) Xi{n{t)), 

so that the equilibrium point should satisfy rij (t) 3;j(n(t)) = \i/iii = pj. But with the stabil- 
ity condition ( [TT] | this contradicts the capacity constraints being tight at the optimal x, so 
no equilibrium point other than can exist in this case, where is a point of discontinuity 
of the gradient of the fluid limit. 
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If, however, the case of integrated streaming and elastic traffic, or the case of peak-rate 
constrained elastic traffic is considered, we do get a non-trivial fluid limit. We show this 
for the peak-rate constraint case later in this section; moreover, we give an algorithm how 
to find this equilibrium point. For integrated streaming and elastic traffic, the existence of 
a unique equilibrium point was already shown in [7J, but we give a quick review of their 
result. We end this section by introducing the notion of complete resource pooling, and 
give conditions that tell us when the equilibrium point corresponds to complete resource 
pooling. 

5.1 Fluid limit for integrated streaming and elastic traffic 

From IZl, we know that under integrated streaming and elastic traffic the fluid limit be- 
comes 

n-(t) = Xi- iJLini{t)xi{n{t),m{t))] 
m'-{t) = Ki - r]imi{t). 

Then for an equilibrium point (m, h) of the fluid limit we have 

rrij = — and UiXi = pi 
Vi 

where Xi is the rate allocation at the equilibrium point Xj(n, m). In ||7| it is shown that Xi 
is the unique solution to the optimization problem 

Maximize Yjiai'^i^ii^i) 

S-t. Er-:ier,i:rei?(0 ("^» + ^ ^3 ^3 ^ 

< > \/iel,re R{i) 

Then x and rh determine n uniquely, hence the equilibrium point is unique. 
On the other hand, with our generalized cut constraints (|5| from Section 2, this optimiza- 
tion problem translates to 

Maximize Yjiai'^i^ii^i) 

S-t. Ei6/(J0^^^^ <C{J')-T.^eI[J')P^ VJ'G^(J), 

> E /. 

Here the strict concavity of the optimization problem is immediate which implies the 
uniqueness of the optimum and of the equilibrium point. Since our optimization problem 
is now exactly of the form Q, the equilibrium point can be found by the algorithm in 
Section 3. 

5.2 Fluid limit for peak-rate constraint elastic traffic 

By introducing peak rates r^, we will always have an equilibrium point for any network 
with routes of length one. The fluid limit becomes 

n-(t) = Xi- Hini{t) mm{xi{n{t)),ri}, 
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so that an equilibrium point satisfies hi = Xi/fii mm{xi{h) , ri)} . It is instructive to see, as 
an example, what happens in the symmetric case, i.e., Vi = r for all i. Then the unique 
equilibrium is h with hi = Xi/{rfii). This equilibrium point exists if Xj(n) > r for all i, i.e., 

C(J') 

mm — > r 

which reduces to the stability condition 

J2 Pi< C{J') VJ' G ^'^(J). 

i6/(J') 

No other equilibrium point can exist, which can be seen as follows. Suppose there would 
be another equilibrium point, i.e., there are certain i that are peak-rate constrained, say all 
i ^ I* , and others that are not. Then i G /* if and only if r < Xi{h). So, for the cluster level 
{I {J'), J') with minimal rate under the usual allocation x{h), we must have I {J') ^ (J*)'^. 
Then for i G I{J'), we have that hiXiifi) = pi. We know from (jlj) that flows i of I{J') will 
take up all the resources in J': 

hiXi{h) = ^ Cj 
i£i{J') jeJ' 

However, at our equilibrium point the left hand side equals Pii hence the 

former equality would violate the stability condition. 

Now, for general peak rates we introduce the following theorem that claims the existence 
of a unique equilibrium point under some condition and also determines an algorithm 
that finds this equilibrium point. 

Theorem 5.1. Consider a network (/, J, C) with routes of length one, traffic intensities pi satis- 
fying the stability condition ([I7[>, and 



^Pi^dJ') VJ' G <^(J),/(J') c /' c j-i(j'). (12) 



Let the peak rates be ordered: ri < r2 < ... < r\jy Then there is always a unique equilibrium 
point hfor the fluid limit. It can be determined by the following algorithm: 
Tor k>l, 

• Tind the minimum 

Xk = mm — ; (IJ) 

i*=i,..\i\,j'&ynj) J2iei(.n.i<i* 

• Let Jk be the union of all strongly connected sets that achieve the minimum above, 1^ := 
I{Jk) 

• Let il be the unique value ofi* such that Xk G (r^* , rj*+i]. 
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• For all i E Ik set Xi = Xk- 

• For i & Ik,i < i*k set hi = pi/ri,for i G i > i*f, set hi = pi/xk- 

• Now, set I := I\Ik, J ■= J\Jk ^nd J{i) := J{i) n {J\Jk), so that we also set I{J') := 
I{J' U Jfc)\/( Jfe). Repeat this procedure with the reduced network until we are left with a 
network without resources and users. 

Moreover, the {Ik, Jk) achieved at each step of the algorithm gives the k-th cluster level at the 
equilibrium point h. Exactly flows in I* = {j^ii & h '■ i < ^1} feak-rate constrained. 

Remark 5.2. We need the condition Y^^^p pi 7^ C{J') because otherwise we could have 
a range of equilibriiun points. Consider, for example, the circle network with N = 3, 

P2 + P3 = C3 and 

ri < < r2 < rs 

pi/n 

Then for all x G (^^y^, r2] we have an equilibrium point: 

Pi . P2 . Pa 
ni = — , 712 = —, ns = — 
ri X X 

Our algorithm would not recognize the full range of equilibrium points but would asso- 
ciate /', J' to the smallest cluster level k such that J {I') C /((J;<^ Ji), and as such give it 
the same rate. 

If the conditions J2ier Pi 7^ C'(J') hold, then at an equilibrium point h we must have at 
least one peak-rate constraint flow in every cluster. This is because otherwise 

^('^') = m = X] ri} = ^^pi^ C{J'). 

iei' iei' iei' 

Then, given a cluster {I', J') of some equilibrium point, the following lemma tells us that 
we can uniquely determine the rate within this cluster and thus also which flows of /' are 
peak-rate constrained. 

Lemma 5.3. For (/', J'), ri < r2 < . . . < r|/| and p, C such that Y^i^p Pi < C{J'), the 
following holds: 

1. There is a unique e {1, . . . , |/|} such that 

^ . C('^0 - T.iel':i>i' Pi ^ ^ 

ri* < — -, < ri*+i 



For this i* any I* Q I with I* Ci I' = {i e I' : i < i*} minimizes 

C{J') ~ Y^iei'n{i*Y Pi 



T Piv ^^^^ 



16 



2. For i' < i* we have 



and for i' > i* 



Here the fraction 



C{J') - E^eI':^>^' > 
J2ier:i<i' Pi/'''i 



< — 1 < ri' 

l^i&I':i<i' Pi/ri 



C{J') - Yli£l'n(I*Y Pi 



Sie/'n/* Pi/''"i 

is the rate x for a cluster (/', J') at an equilibrium point if exactly flows i e I* are peak-rate 
constrained. This follows from the fact that we know that flows i that are not peak-rate 
constrained will take up capacity fiix = pi of the cluster. Then the remaining flows in the 
cluster share the remaining capacity among each other. For fi with 

ni = ^ for i G /* n hi = ^ for i G (rf n I' 

ri X 

to be a feasible equilibrium point, we need x > ri for i ^ and x < rj for i G (/* )'^n /'. 

The lemma says that if there is an equilibrium point with cluster (/', J'), then there is a 
unique i* such that i G /' are peak-rate constraint exactly Hi <i* An particular the lemma 
already implies that only one equilibrium point in complete resource pooling can exist. 
For a proof of this lemma we refer to the appendix. 
To ease notation we write in the following 

/-^ie/'n/* Pini Z^i&I':i<i* Pini 



Proof of Theorem 5.1 We separate the proof in different parts: 

(i) The algorithm is well-defined; 

(ii) The algorithm gives us a feasible equilibrium point; 

(iii) If we have an equilibrium point h, then this h is found by the algorithm. 

Here (ii) gives us the existence of an equilibrium point whereas (iii) proves uniqueness. 
We will proof the parts of the theorem one by one: 



(i) Observe that if the stability conditions ([TTJ hold, the numerator of ( |13| is positive 
for all J' Then the minimum is well-defined and positive and attained for some 
J' and i* > min/(j;) i. Hence by Lemma |5.3| the minimum is greater than rmin^jj,) i 
and there exists a unique > min/j. i such that the minimum is in (r^* , rj*+i] 



Also if the stability conditions hold, by Lemma 5.3 a unique i* corresponding to a 
specific J' is well-defined and if J', i* and J", i** achieve the same minimum then 
i* = i** = since the fractions are by Lemma 5.3 in (r^* , rj.+i] and (rj.. , rj..+i] 
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respectively. We only need to check that the stability conditions hold at each step 
of the algorithm. We know the stability conditions hold initially, and therefore, by 
Lemma 5.3 1 and Lemma A.2 1, A.2 2, and A.2 3, we have for any J' C J\Ji 

n(j' u Ji, /(J' u Ji)j{J') r\{i< > u{Ji,i{Ji),il). 

We thus have 

ie/(JiUJ')\-f(Ji) 

so that the stability conditions hold at the second step of the algorithm. It follows 
that X2 > 0, J2 and i2 are well defined. Then we can use Lemma [53] 1 and Lemma 



A.2 again, and conclude by induction that the stability conditions hold at any step 



k. 

Remark 5.4. To see why the stability conditions are important here, assume for the mo- 
ment that they do not hold and that we have some J', I' = I{J') with X^ie/' Pi — C{J')- 
Then for i* < min// i, the numerator would be or negative (depending on whether the 
inequality holds strictly) and the sum in the denominator would be empty. Then the 
fraction could be made — 00 or g respectively and the minimization would not give us a 
feasible rate. 

(ii) We want to show that the h,x,I* found by the algorithm do indeed correspond to 
an equilibrium point: (A) the x is in line with the allocation x{h) from Theorem |3.1[ 
and (B) it holds that 



Pi Pi -cc ■ ^ T* 

ni = — > ^ iff I e I* 

f^i ^i 



and 



Bi> Pi 



iff i r. 



The latter equations follow immediately from the construction of h and /*, in con- 
junction with Lemma 5.3 1. To see that x = x{h), we have to show that Ji is the 
union of strongly connected J' minimizing (|6|, which reads 

C(J') C(J') 



G/(J') 



Eie/(j')n/* Pi/''"'!- + Eie7'(j')n(/*)'= Pi/^i 



By the choice of Ji and i*, and invoking Lemma A.2 3, we know 

C{Ji) 



minn(/,I(J'),i*) >n(Ji,/(J: 



i* 



Xl 



e/{Ji) 



(15) 



(16) 



By Lemma 5.3 1 the left-hand side is smaller than or equal to n( J', I{J'),I*), which 
implies 

n(jM(j'),r) = ^^-^'1' ^-^^wn(/>)-^- > 

z^ie/(J')n/* Pi/'^'i 



which is equivalent to 



CiJ') 



Eie/(J')n/* r] + Eie/(J')n(/*)'= Pi/^i 



> Xl. 
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Now, by Lemma A.2 4 > xi, so that the right-hand side of p5| is greater than or 
equal to the left-hand side of the previous equation. We thus have that the right- 
hand side of ([15]| is greater than or equal to xi, and therefore by the last equality in 



(16 1 Ji does indeed minimize ( [15| . To see that Ji is the union of all J' minimizing 
this fraction, observe that equality holds in the above argument if and only if J' C 

Ji, i* 



1*1 and 



minn(J',/(J'),r) =U{J',I{J') 



i* 



Xl 



The latter equation is equivalent to 



C(J') 



rii 



Xl 



Sie/(J') 

so Ji is indeed the union of all J' minimizing above. 

Since we have shown in (i) that the stability conditions still hold for the reduced 
network, it follows in the same way that Jk is the solution to the A;-th step of the al- 



gorithm in the algorithm of Thm. 3.1 and so this allocation algorithm for x is indeed 



in line with Thm. 3.1 Hence, the h constructed by the algorithm is an equilibrium 
point. 

(iii) Suppose we have an equilibrium point n with 



max 



: ' Xi{h) 



cluster levels {Ik, Jk) corresponding to rates Xk determined by (|3.1|l and /* = Ufc{^ ^ 



Ik '■ i < i*k}- With conditions (12 i in force, we have that Z^jg/^, Pi / C{Jk), and as 



a consequence we know there must be at least one flow in each cluster which is 



peak-rate constrained. Hence by Lemma 5.3 1, we have that i*^ is the unique value 
such that Tj* < Xk < We can easily see that must be non-decreasing in k 

since the rate Xk is increasing with increasing level, and so flows are more likely to 
be peak-rate constrained. We want to show that Ji is the union of all J' minimizing 



(131, that is. 



ii{j',i{j'),n. 



By Lemma 5.3 1 it is enough to show that each Jk is the solutions of the A;-th step of 



the algorithm of Thm. 5.1 Take any J' G <9"^{J) and partition it into 

J( U J2 U ...J'k such that 4 C Vfc 
Let 4 be I{[]i<k Ji U Jk)\^{V\i<k ^i)- Due to Lemma [32] 1 and|32j3 we know 

C{J'k) _ C{Ji) 



Xk < 



E 



rii 



Pi/ri + Y.i&Ii:i>ilPil^k 



Now, by Lemma 5.3 1, it holds that Xk = ^{Jk,Ik,i*k] 



<^ Xk< U{Jk,Ik,i*k) 
= miiij. U{Jk,Ik,i*) 



and 



therefore by Lemmas A.3 and A.4 we find 

Xk < minn(4,4,z*) 
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Then 



U{j',I{j'),i*) = n (n(4,4,r) : A;) >n{xk :k)>xi 



for all J' , i* , so that Ji and i\ minimize (13 1 and the corresponding minimum is xi. 
Now equality holds in the last inequality only if J' C J^, so all strongly connected 



J' minimizing ( 13 i are subsets of Ji . Conversely, if we partition Ji in strongly con- 
nected sets Ji, then 

ii{Ji,i{Ji),i\) = n (n( j„ /( Ji), > XI 

Since we know equality holds, we must have n( Jj, /( Jj), z^) = xi for all such Jj. 
Hence, Ji, the first cluster level of an equilibrium point, must be the union of all 



strongly connected sets achieving the minimum in (13 1. Since by Lemma A.3 the 



stability conditions still hold for the reduced network, as does condition ( 12 1, we 
can show in the same way that Jk is the solution of the k-th step of the algorithm in 



Thm. 5.1 Hence, any equilibrium point can be found by the algorithm. 



Thus, the algorithm determines the unique equilibrium point. 



□ 



5.3 Complete resource pooling 

The first goal of this section is to formally define what we mean by complete resource pool- 
ing. We remark that Laws [9] and Turner [11 J, among others, used this notion for networks 
where users choose one of a possible set of paths. 

Definition 5.5. We say that in a network {I, J, C) the state {ni)i^i describing the number of 
flows is in complete resource pooling if there exists a neighborhood ofn such that for each n' in 
this neighborhood the optimal x{n') determined by ([ij satisfies 

Xi{n ) = Vz G /. 

This means that if n is in complete resource pooling, then the system behaves as if the 
total capacity is pooled in one resource with every flow having access to it. It is desirable 
that the equilibrium point of the fluid limit is in complete resource pooling, as then the 
capacities are used efficiently in that resources are shared equally over all flows. It is seen 
that, for a given total sum of capacities and total number of flows, the utility is maximized 
in a complete resource pooling state. Also, a nice advantage is that when we know a state 
n is already in complete resource pooling, then increasing the number of routes that a 
flow can use will not change the optimal allocation x{n). In particular this implies that 
the diffusion will be unchanged, as we will see in the next section. However, we note 
that increasing the number of possible routes for one flow will increase the set of states n 
that are in complete resource pooling. For these reasons we want to investigate when the 
equilibrium point is in complete resource pooling. 
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5.3.1 Complete resource pooling for integrated streaming and elastic traffic 

In the case of integrated streaming and elastic traffic we can determine more explicitly 
when the equilibrium point is in complete resource pooling. 

Theorem 5.6. In the integrated streaming and elastic traffic case, a sufficient and necessary con- 
dition for the equilibrium point being in complete resource pooling is 

«-c(j»)>-psii^£^fc(,7')- p.]. 

Proof. Consider Ui = pi/ x, rrii = Ki/ rji for alH G / where 
Then x satisfies 

C{J) 

So it is the common rate if we have complete resource pooling at (n, m) and if so, (n, m) 
will be an equilibrium point. In order for x to be the rate Xj(n, m) for all i determined by 
we require for all J' £ y^{J) that 

^ < g(-^0 ^ c{j') 

Substituting for x, this is equivalent to 

□ 

Since by stability the right-hand side is strictly negative, the inequality is satisfied if the 
left-hand side is non-negative. Thus, the condition in ( |5.8| is also sufficient for complete 
resource pooling in this case. 

Corollary 5.7. In the integrated streaming and elastic traffic case, a sufficient condition for the 
equilibrium point being in complete resource pooling is 

^ Pi> C{J') for all J' with {J'f G ^t^iJ) 

We will use these results about the equilibrium point being in complete resource pooling 
in the next section when we study the diffusion approximation of the processes. 
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5.3.2 Complete resource pooling for peak-rate constrained elastic traffic 

The following theorem determines a sufficient condition for complete resource pooling 
depending only on the traffic intensities pi of elastic traffic and not on the peak rates. 

Theorem 5.8. In the peak-rate constrained case, a sujficient condition for the existence of an 
equilibrium point in complete resource pooling is 

^ Pi> C{J') VJ' G "^(J) 
Proof. If the equilibrium point is in complete resource pooling the common rate must be 

We want to show that at n with hi = pijri for i < i* and fij = pi/x for i > i* , we indeed 
have complete resource pooling under our condition. Suppose not, then say J' is the 
cluster with maximal rate Xmax > x, then by 

C{J')= ^ niXraa.^> ^ nj min(x, Tj) = ^ pi 

contradicting the sufficient condition. □ 
In general, by ( |5.1| the equilibrium point is in complete resource pooling if and only if 

C{J) - Y.i>i* Pi _^ '^('^0 - Y^i>i*,i&I{J') Pi 
J2i<i* Pi/'^'i J2i<i*,i(^I{J') Pi/'''i 

for all J' € S^^{J), where i* minimizes the left-hand side over i G {1, . . . , |/|}. However, 
unlike the previous sufficient condition, these inequalities do not have a clear interpreta- 
tion. 

6 Symmetric circle network: diffusion results 

In this section we study the diffusion limit of our processes around the equilibrium point 
h of the fluid limit that we identified in the previous section. We do so for a special type 
of network, namely the symmetric circle network which we introduce in detail below; the 
setting we consider is that of integrated streaming and elastic traffic. Our most important 
contribution is that we explicitly determine the stationary distribution to which the diffu- 
sion limit converges as t tends to infinity. In particular we calculate the covariances of the 
numbers of flows of different types, and we prove that these are positive. The last part 
of the section will be devoted to obtaining insight in the state of the network conditional 
on congestion, where we define congestion as the event that at least one of the user types 
gets a transmission rate that is less than a certain critical value e. Based on this stationary 
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distribution we develop an estimate for the probability that, given congestion, the flow 
type with this minimal rate is in a cluster of size k and compare these probabilities for dif- 
ferent values of k. We find that in the limiting regime where N, the size of the network, 
goes to infinity the most likely value for A; is r — 1 where r is the number of routes that 
each flow is allowed to use. 



6.1 Diffusion limit 

We consider the fluid limit for a process of |I| type of flows, determined by the (coupled) 
differential equations n'^{t) = Aj — <I>j(n(t)), which have a unique equilibrium point, say 
n. Then the diffusion limit is the process 

n^{t) - Lh 

1j 



in the limit as L goes to infinity. This process, call it It, satisfies approximately the follow- 
ing stochastic differential equation 

dYt = -PYtdt + dWt 

where 

• the matrix P is obtained from the linearization around the equilibrium point n[{t) 
-P{n{t) - n), that is 



p.. 

duj 

• Wt is DBt where Wt is an |I|-dimensional vector of independent standard Brownian 
motions and D the diagonal matrix with entries Da = + ^i{t). 

As t tends to infinity, this diffusion limit process converges to a multivariate normal dis- 
tribution with mean zero and a covariance matrix that can be determined via 

/■oo 

E(yy^) = / e-^*ylA^e-^^*dt, (17) 

JO 

see e.g. ||3| for more background on this approach. 

In general calculating e~^*, as well as the covariance matrix, in closed-form is not possi- 
ble. However, if we assume the equilibrium point is in complete resource pooling, all of 
the rates are of the form + rrii)), and a small perturbation of the number 

of flows of any type will not affect that we are in complete resource pooling. This means 
that dxi/duj, evaluated in h, is the same for all i, j, and the matrix P will be of the form 



Pij = 6ijr]i_N N <i<2N,j <2N, 



23 



where the first N indices correspond to the elastic user types, and the last N indices to 
the streaming user types. 

An obvious model to ease the calculation is one in which the equilibrium point is in 
complete resource pooling because then the derivative ^^'j^'.™^ \h,rh is the same for all i < 
N. Also if this happens, the equilibrium point is the same if we increase the number of 
routes that a flow can use and thus, the diffusion will be the same. 

We now show how to compute the corresponding covariance matrix explicitly in the case 
of a purely symmetric circle network. 



6.2 The purely symmetric circle network 

We consider a network consisting of N resources of certain capacities, where each re- 
source is a route of length one. There are N different flow types that are each shar- 
ing over r consecutive routes, where r is some integer greater than 1, that is J{i) = 
{i,i + l,...,i + r — 1} (where these numbers should be taken modulo N, to make sure 
that we obtain route numbers in the set {1, ... , N}). 

Here a strongly connected set J' is such that J' = {i,i + 1, . . . ,i + k — 1} for some i = 
1, . . . , N, k = r, . . . , N and the corresponding I{J') is the arc {i, . . . ,i + k — r} for k < N 
or {1, ...N} for k = N. Then the generalized cut constraints of ^ read 

i+fc-l 'i+fe+r-2 
j=i j=i 

for i = 1, . . . , N and k = 1, ...N — r, and 

N N 

j=i i=i 



It turns out that the minimal rate can be evaluated by Theorem 3.3 



as: 



j=i W 2^j=l ^ : 



mm Xi = mm < — ^— -; — ^ , — ^ . 

.=i,...;v,.=i,...;v-. \ j:ff-'n, 'Ef=in,j 

In the sequel we analyze this circle network in the purely symmetric case: The arrival 
rate, capacities and mean flow sizes are assumed to be uniform across all user types, i.e., 
Xi = A, /Xj = /i, Ki = K, r]i = 7] for all i and Cj = C for all j; as before, we write p = A//x. 
Recall the dynamics of the fluid limit for integrated streaming and elastic traffic from 
Section 5.2. For our purely symmetric case the equilibrium point can easily be seen to be 

K . ^ C — p „ „ pm 
m,- = m = — , Xj = X = — - — , n,- = n 



f] m ^ ~ P 

We note that this is independent of r, the number of routes that a flow can use. In the next 
subsection we will explicitly determine the covariance matrix using ([17||. 
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6.3 Calculation of the covariance matrix 

Recalling the dynamics of the fluid limit from Section 5.2 we see that for our case P is of 
the form 

Hi ■) 

where A,B,C are all AT x AT matrices. Here A is given by (with i ^ j) 

P P \ A P{C - p) 



A ^ ~P f-i P \ 



A 



All entries of B are equal and given by 

p{C-p) 



Bij = —p, 



NCk/ti 



Finally C is a diagonal matrix, with all diagonal elements equalling rj. 

Our first goal is to compute e~^*. Due to the structure of P this is of the form 



^ ^[l,Ar]x[Af+l,2Af] 



e 



-Ct 



here jv]x[Ar+i,2Ar] denotes the submatrix consisting of the first rows and the last 
N columns of a 2n x 2 AT matrix M. Note that A is of the form —Q + dl where Q is a 
generator matrix with all off -diagonal entries equalling q, I the identity matrix and q and 
d are positive reals given by 

p{C-p) M(g-p)^ 
^ ^ NCk/ti ' CK/eta ' 

It follows that e~^^ = e~^^e^^ where e^^ is a stochastic matrix. To calculate e^^ explicitly, 
observe that because of the symmetry all diagonal entries must be equal, as well as all 
off-diagonal entries. Merging states 2 to AT we can see that ef/ is the same as g^i^ for 



Q' 



-{N-l)q (Ar-l)g 
q -q 



Calculating eigenvalues gives us e^j^* = + (A^ — l)e ^'^*). Thus we have determined 
the matrix e"^^: For i / j, 

With C = rjl, we immediately have that e~^* = e"''* J. 

It is left to compute (e~^*)[i jv]x[Ar+i,2Ar]- We use that S is a completely symmetric matrix 
with all entries equalling —q. Observe 

fc-i 

pfe \ ^ /~ik—l—i ID Ai 

^[l,N]x[N+l,2N] — 
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With A = -Q + dwe get 



j=0 



Lemma 6.1. —{—Qy is a completely symmetric generator matrix, i.e., a generator with all diag- 
onal entries equal, as well as all off-diagonal entries equal. 

Proof. Proof by induction. Say —{—Qy~^ is a generator matrix with off-diagonal entries 
b and diagonal ones — (A^ — 1)6. Then 

-(-Q)|. = -((AT - Ifbq + {N- l)bq) = -N{N - l)bq < 
-i-QYii' =-i-2{N-l)bq+{N-2)bq)=Nbq>0 for i ^ i' 

and 

k 

□ 

Since scaling and adding up completely symmetric generator matrices preserves the sym- 
metry and generator property, we have that = —Q + d^I for some completely symmet- 
ric generator matrix Q. It follows that 

fc-i 



P[l,N]x[N+l,2N] —'^^'^ ^ ^B{-Q + d'I). 



1=0 

Now note that BQ = since B has all entries equal and since columns of Q sum up to 0. 
We therefore have that 

_ R k-i-iji _ R fe-il - {dh)'' _ r^ri^ - 

^{l,N]x[N+l,2N]- B d-tlT] r,-d' 

which implies that 

-Pt sr^ r.^^ - dH-tf e-'^^-e-'" 



e 



r '/ \-^) _ 

[l,7V]x[iV+l,2iV]-Z^^ J ^, • 

fc>0 ' ' 

Now, we can calculate the covariance matrix, corresponding to the steady-state of the 
diffusion, as in ([T7|l, with D the diagonal matrix with entries 



Dr 



2A ifi = l,...N, 

2^ if i = iV + 1,...2A^. 



This finally gives us the covariance matrix: for i / j we have 



26 



and 

Ik A(C — p) k 
' N 7] (/u(C — pY + Ck) rj 

The results on the rrii are of course in line with the fact that the numbers of streaming 
flows correspond to independent Poisson distributions. 

We see that the all covariances are strictly positive. This could be expected, since an in- 
crease in streaming or elastic flows of one type results in less capacity for the other flows, 
and therefore an increase in the number of elastic flows of other types. Since the equilib- 
rium distribution is in complete resource pooling it does not make a difference whether 
these flows are close to the increasing flows or not. Also the decay of these covariances in 
is plausible because, given that the equilibrium point is in complete resource pooling, 
the impact of the increase in flows of another type should decrease in the number of dif- 
ferent flow types. Assuming this stationary distribution, (rij + mi)i^i is also distributed 
multivariate normal with mean 

lll(nj + rrii) = n + m = — - 



rjC - p 

and covariance matrix 

K C 

rjC - p 

^ := Cov(nj + rrii, + rrij) = Cov(nj, rij) + 2 Cov(ni, mj). 



Y := Var(nj + mj) = Var(nj) + Var(mj) + 2 Cov(nj, TTij) = — — h Cov(nj, nj), 



6.4 State of the network given congestion 

We now want to use the above results to estimate the probabilities of the flow of minimal 
rate being in a cluster of size k, given there is congestion. We define the event of conges- 
tion by requiring that there is at least one user type for which the rate allocated to a single 
flow, Xi, is below a critical threshold e. We know from ^ in Section 3 that 



Xi < e 



We want to find the value of k that maximizes this probability. An evident approximation, 
which makes sense for e very small, is, with S'ik the event that user type i is in a cluster of 
size k, 




N -¥{711 + ..nk> {k + r-l)/€) for k < N - r, 
P(ni + ..UN > N/e) for k = N. 



F{3xi < e, <^ik) - 
Using the multivariate Normal approximation, we write this as 



AT ( 1 - ^ ( (fc+r-l)/e-fc(n+m) \ \ i^r k < N - r, 

N/e-N(n+rn) \ ior k = N. 



(18) 



27 



Observe here that for a fixed k smaller than N this probability is decreasing in r, indicat- 
ing that (as expected) the minimal rate is increasing in r. This observation confirms that 
the greater the number of routes a flow can use, the more efficient the network operates. 
For fixed r the value for k with highest probability (among all values smaller than N) is 
the one where 

(/c + r — l)/e — k{n + rh) 

is minimal. For e small the dominating term is 

k+r -1 1 



VA; V + r - <rA; e ■ 



(19) 



By differentiating one can check that if y — (2(r — 1) + 1)'^ > 0, the minimal value will 
be at 

(r-l)(r-^) 
° r - {2{r - 1) + 1)^ 

Now, recall from the expressions for f and ^ that we can write for some ^' that does not 
depend on A^: 

■qC-p N N 

Then when N grows large, tends to zero, which implies that Y — (2(r — 1) + l)*^ > 
tends to 

r]C - p' 

which is larger than zero and thus the most likely k is k^, which tends to r — 1 as N ^ oo. 



We want to compare the value of ( 19 1 for k = r — 1 with the corresponding argument of 

for r = o(iV), 



<I> in (|18| for k = N. For A; = r - 1 we find 



whereas for k = N 



N 



oo. 



Thus, when N is sufficiently large, and if r is o{N), k = r — 1 indeed maximizes the 
probability of a flow with a very small rate being in a cluster of size k. 
The above computations indicate that for the minimal rate to be very small, we need r — 1 
flow types to be congested. Thus, in the case where we split flow over two routes only, 
the minimal rate can become very small as the result of the number of flows of one type 
growing very large. In the case r = 3, however, when each flow can use three routes, we 
need two consecutive flow types to be congested in order for the minimal rate becoming 
very small. This seems to be a much rarer event and it suggests that increasing the num- 
ber of routes that a flow can use from 2 to 3 brings substantial performance improvements 
in the circle model. This is in line with results by Turner ||T2|, where the circle network 
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is considered in a slightly different setting: there customers cannot split their traffic on 
different routes but choose the least loaded of a set of r neighboring routes. Turner's sim- 
ulations show that for the circle network there is a considerable quantative difference in 
the probabilities that a queue becomes very large for r = 2 and r = 3. 

Acknowledgements: The authors of this paper are indebted to Frank Kelly for many in- 
valuable remarks and suggestions. 
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A Appendix 



A.l Proofs related to Section 3 

Lemma A.l. 1. A resource allocation {Ai)i(=i = {niXi)i^i > 0/or a network as in section 2 with routes 
of length one is feasible if and only if the following generalized cut constraints hold: 

VJ' e ^■^( J) : A, < ^ Cj (20) 

lei(J') jeJ' 

2. None of the constraints above are redundant, that is excluding any one constraint will not guarantee 
feasibility. 



Note that if 1 20 1 holds, then the same constraints hold for any subset J' of J since we can partition 
J' in a finite number of strongly connected components Ji, J2... Jmr each satisfying the constraints. 
Then /(./') = I{Ji) U ... U I{J,n) with all the I{Jk) pairwise disjoint and the inequality follows. 

Proof. 1 . The first part is an immediate consequence of the max-flow / min-cut theorem, which is 
seen as follows. Consider the bipartite graph of nodes /, ,/ where ij is an edge if and only if 
j e Jii)- Further, connect a source s with alH e / and all j E J with the sink t. Denote the 
capacity of edge e by C(e). Let the capacity of edge si equal and the capacity of jt be Cj. The 
remaining capacities are infinitely large. Now, there exists an allocation A^ in our problem if and 
only if there exists a total flow J^iei network. Now, by the max-flow min-cut theorem 

there exists a flow J2iei ^^'^ only if J2iei ^« — See(S t) ^i^) '^^^^ i^' there is 

e e {S, T) such that C(e) = 00, the corresponding constraint is certainly satisfied, so we only want 
to consider cuts of the form 

S = rufu{s}, r = /'"UJ"=U{0 where /' C /, J(/') C J' C J 

Then the constraints are 

we only need 

Ea«<Ea^+ E ^ Ea.< E c',' 

lei iei"= jeJ{i') ier jeJ(i') 

which shows that the given constraints are necessary and sufficient for a feasible allocation. 



2. We now need to prove that none of the constraints of pO| | are redundant. To show this, fix a 
J € {J). We aim to find a A > for which the constraint corresponding to J is violated while 
all other constraints in | [20) still hold. 

For each j E J let kj be the number of i G I (J) such that j £ J{i). Let e be smaller than both 

minjgj Cj and min^^ j Cj/kj. Now, for i E I{J), let 

A.= y ^ + ^ 

Otherwise let A^ be 0. For J, the left-hand side of the constraint reads J^j^j + ^- Hence the con- 
straint is violated by e, as desired. Consider J' e S^'ta{J) such that J' C J. By strong connectivity 
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of J there exists i* e I{J) such that J{i*) n J' ^ (!) but i* ^ I{J'). So 
For J' % J we can find a j* e J' such that j* ^ J. Then 

E E ^^ + '< E Q + Q-<E^^ 

lei(J') jeJ'nJ jeJ'nJ i&J' 



This shows that, indeed, we need every constraint in ( [20| for sufficiency in the theorem. This 
holds even if we restrict to > for all i since all of the non-violating constraints are not tight 
here. □ 



Proof of Lemma 3.2 1. This follows immediately from the fact that each J' <Z J can be parti- 
tioned into strongly connected sets J^. Then 

r{I{J'),J') = n{r{I{J,),J,):i)>Xk 

since r{I{Ji), Ji) > Xk for all i by minimality of x^. 

2. For equality to hold in part 1 of this lemma, we need 

r{I{Ji),J,) = Xk yji 

for all strongly connected sets Ji in the partition of J'. So Ji C for all i and so J' Q Jk- 

3. Assume there are J', J" C J such that 

r{I{J"),J")^r{I{J'),J')=Xk 
Consider the union J' U J". With 

c{j') + c{j") - c{j' n J") = c{j' u J") 

and 

/( J') + i{J") - i{J' n J") c /( / u J") 

we have 

r(/(j'U J"), J'U J") 

c( JQ + C{J") - cjj' n J") 

(C(J') + c( - C(J' n j")/r{i{j' n J"), J' n J") 

If the intersection J' n J" is empty, then the result follows easily. Otherwise we know from 
part 1 of this lemma that the rate for the intersection (/(J' n J"), J' n J") must be greater 
than or equal to Xk- Hence 

r(/(j'U J"),/U J") <Xk 

Since this being strictly smaller contradicts part 1, we have equality above, and thus con- 
clude by induction for the union Jk of all such J' that 

r{I{Jk), Jk) = Xk 
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Note that for the inequalities above to hold tight we require 

r{i{j'nJ"),J'nr) = xk 

and 

/(J'U J") = /(J')U/(J")• 
Hence we also have that 

i{Jk) = u ^(J') 

J'£y€(J):r{I{J'),J')=Xk 

4. Suppose Xk > Xk+i- Then for Jk U Jk+i 

r{I{Jk U Jfc+i), Jk U Jk+i) = r{Ik U h+i-Jk U J/c+i) = (x^, Xfc+i) < Xfe 



which by Lemma 3.2 1 and 3.2 2 implies J^+i = 0. So either there is no [k + l)-th cluster 
level so no Xk+i exists, or Xk < Xk+i- 

□ 

A.2 Proofs related to Section 5 



Proof of Lemma 5.3 Observe that by the stability condition 

rminj, i < n(J',/',mini) 

Now, for i' > min// i 

r,,+i <n(j',/',0 

is equivalent to 

r,,+i <n(J',/',z' + l) 
by simple transformation of the inequality. Also, 

n(j',/',z' + i) <u{f,r,i'), 

where strictly holds for i' + 1 € I', because the fraction on the left-hand side arises by adding pf+i 
to the numerator, and pi'+i/ri'+i to the denominator of the fraction on the right-hand side. Here 
we are using 

A+C A C A 

for positive A, B,C, D. So, we have a decreasing sequence of fractions for i' ~ 1,2,... greater than 
Ti'+i until for i' = i* 

n, <n(j',/',r) <r,.+i 

where i* could be |/| with = oo. This proves that there is a unique i* such that the corre- 

sponding fraction is in (r^* , ri*^i]. For i' > i* we deduce similarly to above that the fractions are 
non-decreasing and also in the same way as above it follows 

n(j',/',i')<^z' (22) 
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It holds that if n( J', < r.,.+i,thenn(J',/',i' + l) < r,/+i, and therefore n( J', i' + l) < r,,+2 
so that n( J', /', i') < Til for all i' > i*. This proves part 2 of the lemma. Now, we want to show 
that I* = {i < i*} achieves the minimum. Suppose there is i E I' , i < i* such that i ^ I*. Then 



This follows because the fraction on the left hand side arises by adding pi to the numerator and 
Pi I Ti to the denominator of the expression on the right-hand side which we assumed was greater 
than ri . Here we are using 1 21 1 again. So for minimality we need i' e /* for all i' < I*. Conversely, 
suppose there is i E I' , i > i* such that i E I*. Then in the same way 

- I]ie/'n((/*)<=u{i}) Pi ^ C'(J') - Y.iei'nii')" Pi 



J2iei'n{i'\{i}) P^l'^'i J2ierni' P^/^i 

where equality only holds if i = i* + 1 and x ~ r^.+i so in the case where we could let i be both 
peak-rate constraint and not. So I*{i < i*}is indeed minimizing the fraction, and we have proved 
the lemma. 

Alternatively, for a more intuitive explanation for why the lemma should hold, observe that at an 
equilibrium point fii = max(pi/ii, pi/ri), so for the rate in a cluster (/', J') we have 

C{J') ^ C{J') 



for any /** C /. Since we assume (/', J') is a cluster, Xi — x' for all i E I', so the inequality is 
equivalent to 

_ C{J') - E.ei'n(i'r < C{J') - E.6/.-n/' P^ 



J2iei'ni* Pi/'''i '}li£{i**Yr]i' Pil'^i 

where /* is the set of peak-rate constraint flows corresponding to n. So x' can indeed be evaluated 
as the minimum of | (T4) over all /* C /. Now, we can find i* E I such that 

r^. < X < r^.+i 

where we can argue that i* > min// i by the stability condition. Then we can argue in a similar 
way to above that I* = {i E I' : i < i*} achieves this minimum x'. □ 



The following lemma is the analogue of Lemma[3.2|for the algorithm in Theorem 5.1 



Lemma A.2. At each step of the algorithm in Theorem ^l] for the corresponding I, J the following holds: 

1. \fj' CJ : min,. n(J', I{J'),i*) > Xk] 

2. If for J' C J it holds that min,. n( J', I{J'),i*) = Xk, then J' C Jj.; 

3. miiii. Il{Jk,Ik,i*) — Xk, so Jk corresponds to the same il; 

4. Xk < Xk+i- 



Proof. 1. By the stability condition and Lemma 5.3 again 

minn(J',/(J'),r) > rinin^(j,,j, 

i.e., the minimum is achieved for some i* > min/jj/) i. Then if J' can be partitioned in strongly 
connected Jj 

n(j',/(j'),r) = n(n{j,,iij,),i*)) > n (mmn(j„/(j,),f *)) > xk. 
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2. For the inequality in part 1 (of this lemma) to hold tight we need min,* n( J,, /( J^), i*) = Xk to 
hold for all strongly connected sets Ji in the partition of J'. Thus, J' C J^. 

3. We know by Lemma 5.3 1) that if J' achieves the minimum in |[T3| for some i* , then we have 



that n( J', /(J'), il) = Xk. Also 



\jl{J')^I{Jk) 



and so 



n(Jfe, 4, < ^ (n( J', /( J'), = ^fe; 



with part 1 of this lemma we conclude equality and that i\ minimizes n( J^, J^, i*). Also, we get 
I{Jk) ^{}I{J') andmin,. n(Jfe,/fc,i*) = (min,* n(J',/',i*)) 
4. Suppose not and x^ > Xk+i, then for the union Jk U Jk+i- 

C{JkU Jk+i) -J2iei{.hu.h+,)n{i*rP^ . ... 

= = II {Xk,Xk+lj < Xk- 



By Lemma 5.3 1) this implies 



minn(Jfc U Jk+i,I{Jk U Jfc+i), «*) < Xk 



and by Lemma A.2 1 and A. 2 2 we deduce Jk+i = 0- So either there is no (fc + l)-th cluster or 

Xk < Xk + l- □ 



Lemma A.3. For an equilibrium point n, as given in part 3 of the proof of Theorem 5.1 we have for all k, 
4 C Jk and r, = /(U,<, Ji U J'k)\in^k Ji)-- 

Proof. Since the cluster levels are given and x is a feasible allocation, we know that 

Since n is an equilibrium point, the left-hand side is greater than or equal to X^ie/' Pi- ^if^* condi- 
tion 1 12 1 we conclude 

□ 



Lemma A.4. For given /' ,1" Q I and J' ,J"QJ with 



J2Pr<C{J') and ^ft<C(J") 



suppose that 

minn(J',/',i*) < n(J",/",i*) 
for i* minimizing the left-hand side. Then 

minn(J',/',r) < minn(J",/",r*) 



(23) 



(24) 



(25) 
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Proof. Conditions 1 11 1 allow us to use Lemma 5.3 Lemma 5.3 1 tells us that mini. n( J', /', i*) € 

(ri-;rj.+i] so 



n(J", >r,.. 



Then by Lemma 5.3 2 we have that apparently i* < i**, where i** is the unique value from Lemma 
]3]l such that 



minn(j", /",«*) G {r.i*. ,ri,*+i] 



and which minimizes the fraction. Now (i) either i* < i**, and hence 

minn(J',/',r) < minn(J",/",i**), 
or i* — i** , SO that l(25l follows from (|24l. 



□ 
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